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ON-CHIP DYNAMIC BUFFER LEVEL 
INDICATORS FOR DIGITAL VIDEO ENCODER 

Cross-Ref erence to Related Patent 

This application relates to the following 
5 commonly assigned United States Letters Patent: 

United States Patent No. 5,760,836, issued June 
2, 1998, by Greenfield et al., and entitled "FIFO 
FEEDBACK AND CONTROL FOR DIGITAL VIDEO ENCODER." 

This patent is hereby incorporated herein by 
10 reference in its entirety. 

Technical Field 

This invention relates to digital video 
encoding, such as MPEG- 2 compliant digital video 
encoding and HDTV compliant encoding. More 

15 particularly, the invention relates to monitoring of 
the encoder output buffer, such as a FIFO buffer, 
field buffer or cascaded buffers, and providing from 
the encoder to the host in real time a dynamic buffer 
level indicator indicative of the fullness of the 

2 0 external buffer. 

Background of the Invention 

One example of an emerging video compression 
standard is the Moving Picture Expert's Group 
("MPEG") standard. Within the MPEG standard, video 
25 compression is defined both within a given picture, 
i.e., spatial compression, and between pictures, 
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i.e., temporal compression. Video compression within 
a picture is accomplished by conversion of the 
digital image from the time domain to the frequency 
domain by a discrete cosine transform, quantization, 
5 variable length coding, and Huffman coding (both 
collectively referred to as "run length coding 1 ') . 
Video compression between pictures is accomplished 
via a process referred to as "motion compensation" in 
which a motion vector is used to describe the 
10 translation of a set of picture elements (pels) from 
one picture to another. 

For MPEG- 2 video encoding, FIFOs are often used 
to capture video data which has been compressed to 
the MPEG-2 standard, that is digital video data that 

15 has been spatially and temporally compressed, as by 
discrete cosine transformation, quantization, 
variable length coding, Huffman coding, and motion 
estimation. In many applications, the FIFOs are 
unloaded "real time" for transmission of full motion 

2 0 video through a transmission medium. In certain 

applications, reading of data from the FIFOs may be 
required only after a predetermined amount of data is 
loaded into the FIFOs. In other MPEG-2 encoding 
applications, memory devices instead of FIFOs may be 

25 used to capture compressed video data. Some of these 
devices, such as field memories, do not provide any 
memory flags which would be useful in reading the 
memory device when the device is empty or in 
notifying a host of the memory status. 
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Disclosure of the Invention 



This invention monitors the fullness of the 
external buffer and provides in real time a dynamic 
buffer level indicator indicative of the fullness of 
5 the external buffer. The buffer fullness may be 
represented by one or more of a BUFFER_EMPTY flag, 
BUFFER_ALMOST_FULL flag and BUFFER_FULL flag. The 
fullness of the external buffer can be significant 
for a number of reasons. For example, a host system 

10 may require that fullness of an external buffer reach 
a predefined threshold before reading data from the 
buffer. Further, the bitrate of a compressed digital 
video data stream, such as an MPEG- 2 compliant data 
stream or HDTV compliant data stream, can be adjusted 

15 by varying the amount of quantization for the 

frequency coefficients in a macroblock after the 
discrete cosine transformation (DCT) . The expedient 
wherein the quantization factor or stepsize is 
controlled solely as a function of the "fullness" of 

2 0 the external buffer is described in the MPEG- 2 

standard documentation. The scaling factor by which 
this is performed uniformly over a macroblock is 
referred to as a quantization factor or "stepsize". 
Therefore, by using a large stepsize more compression 
25 will result which reduces the compressed stream 

bitrate but also reduces picture quality. A small 
stepsize increases the bitrate and picture quality. 

According to the present invention, a method and 
encoder apparatus are provided for encoding a digital 

3 0 video image stream. The encoding includes spatial 

compression of still images in the digital video 
image stream and temporal compression between the 
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still images. The spatial compression is carried out 
by converting a time domain image of a macroblock to 
a frequency domain image of the macroblock, taking 
the discrete cosine transform of the frequency domain 
5 image, transforming the discrete cosine transformed 
macroblock image by a quantization factor, and run 
length encoding the quantized discrete cosine 
transformed macroblock image. The temporal 
compression is carried out by reconstructing the run 

10 length encoded, quantized, discrete cosine 

transformed image of the macroblock, searching for a 
best match macroblock, and constructing a motion 
vector between them. This forms a bitstream for run 
length encoded, quantized, discrete cosine 

15 transformed macroblocks and of motion vectors. This 
bitstream is passed through an external buffer, such 
as a FIFO, to a transmission medium. The number of 
run length encoded bits is fed back to the encoder 
for monitoring of the buffer fullness and providing a 

2 0 host processor with a dynamic buffer level indicator 

in real time indicative of the fullness of the 
external buffer. The indicator from the encoder to 
the host system may include one or more of a 
BUFFER_EMPTY flag, BUFFER J\LMOST_FULL flag and 
25 BUFFER_FULL flag. 

Advantageously, the method and encoder apparatus 
of the present invention provides a dynamic buffer 
level indicator to assist the host application and 
the control of reading compressed data from the 

3 0 external buffer coupled to the encoder. This buffer 

level indicator is dynamic in that the indicator is 
adjusted based on continuous real-time monitoring of 
the fullness of the external buffer. In one aspect, 
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a BUFFER_EMPTY flag, a BUFFER_ALMOST_FULL flag, and a 
BUFFER_FULL flag are provided to assist the host 
application in controlling reading of compressed data 
from the encoder. This can be significant with field 
5 memories or cascaded FIFOs or other memory devices. 

Brief Description of the Drawings 

The above-described objects, advantages and 
features of the present invention, as well as others, 
will be more readily understood from the following 
10 detailed description of certain preferred embodiments 
of the invention, when considered in conjunction with 
the accompanying drawings in which: 

Fig, 1 shows a flow diagram of a generalized 
MPEG- 2 compliant encoder 11, including a discrete 

15 cosine transformer 21, a quantizer 23, a variable 
length coder 25, an outlet FIFO buffer 51 with 
feedback back to the quantizer 23, an inverse 
quantizer 29, and inverse discrete cosine transformer 
31, motion compensation 41, frame memory 42, and 

20 motion estimation 43. The data paths include the 
picture input 111, difference data 112, motion 
vectors 113, the picture output 121, the feedback 
picture for motion estimation and compensation 131, 
and the motion compensated picture 101. This figure 

25 has the assumptions that the i* picture exists in 

frame memory or frame store 42, and the i+l 1 * 1 picture 
is being encoded with motion estimation. 

Fig. 2 illustrates the I, P, and B pictures, 
examples of their display and transmission orders, 
3 0 and forward, and backward motion prediction. 



EN998073 



-5- 



Fig. 3 illustrates the search from the motion 
estimation block in the current frame or picture to 
the best matching block in a subsequent or previous 
frame or picture. Elements 211 and 211' represent 
5 the same location in both pictures. 

Fig. 4 illustrates the movement of blocks in 
accordance with the motion vectors from their 
position in a previous picture to a new picture, and 
the previous picture's blocks adjusted after using 
10 motion vectors. 



Fig. 5 shows one embodiment of encoder logic 
comprising a FIFO buffer monitoring and indicator 
system in accordance with the present invention. 

Fig. 6 depicts an alternate embodiment of 
15 encoder logic comprising a field buffer monitoring 
and indicator system in accordance with the present 
invention. 



Best Mode for Carrying Out the Invention 

The invention relates to MPEG- 2 and HDTV 
20 compliant encoders and encoding processes. The 

encoding functions performed by the encoder include 
data input, motion estimation, macroblock mode 
generation, data reconstruction, entropy coding, and 
data output. Motion estimation and compensation are 
25 the temporal compression functions. They are 
repetitive functions with high computational 
requirements, and they include intensive 
reconstructive processing such as inverse discrete 
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cosine transformation, inverse quantization, and 
motion compensation. 

Motion compensation exploits temporal redundancy 
by dividing the current picture into blocks, for 
5 example, macroblocks, and then searching in 

previously transmitted pictures for a nearby block 
with similar content. Only the difference between 
the current block pels and the predicted block pels 
extracted from the reference picture is actually 
10 compressed for transmission and thereafter 
transmitted. 

The simplest method of motion compensation and 
prediction is to record the luminance and 
chrominance, i.e., intensity and color of every pixel 
15 in an "I" picture, then record changes of luminance 
and chrominance, i.e., intensity and color for every 
specific pixel in the subsequent picture. However, 
this is uneconomical in transmission medium 
bandwidth, memory, processor capacity, and processing 

2 0 time because objects move between pictures, that is, 

pixel contents move from one location in one picture 
to a different location in a subsequent picture. A 
more advanced idea is to use a previous picture to 
predict where a block of pixels will be in a 
25 subsequent picture or pictures, for example, with 

motion vectors, and to write the result as "predicted 
pictures" or "P" pictures. More particularly, this 
involves making a best estimate or prediction of 
where the pixels or macroblocks of pixels of the i+l* 

3 0 picture will be in the 1 th picture. It is one step 

further to use both subsequent and previous pictures 
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to predict where a block of pixels will be in an 
intermediate or "B" picture. 

To be noted is that the picture encoding order 
and the picture transmission order do not necessarily 
5 match the picture display order. See Fig. 2. For I- 
P-B systems the input picture transmission order is 
different from the encoding order and the input 
pictures must be temporarily stored until used for 
encoding. A buffer stores this input until it is 
10 used. 

For purposes of illustration, a generalized flow 
chart of MPEG compliant encoding is shown in Fig. 1. 
In the flow chart the images of the 1 th picture and 
the i+l* picture are processed to generate motion 

15 vectors. The motion vectors predict where a 

macroblock of pixels will be in a prior and/or 
subsequent picture. The use of the motion vectors 
instead of full images is a key aspect of temporal 
compression in the MPEG and HDTV standards. As shown 

20 in Fig. 1 the motion vectors, once generated, are 

used for the translation of the macroblocks of pixels 
from the 1 th picture to the i+l* picture. 

As shown in Fig. 1, in the encoding process, the 
images of the i* picture and the i + l* 1 picture are 

25 processed in the encoder 11 to generate motion 

vectors which are the form in which, for example, the 
i+l* and subsequent pictures are encoded and 
transmitted. An input image of a subsequent picture 
goes to the Motion Estimation unit 43 of the encoder. 

3 0 Motion vectors 113 are formed as the output of the 

Motion Estimation unit 43. These vectors are used by 



EN998073 



-8- 



the Motion Compensation Unit 41 to retrieve 
macroblock data from previous and/or future pictures, 
referred to as "reference" data, for output by this 
unit. One output of the Motion Compensation Unit 41 
5 is negatively summed with the output from the Motion 
Estimation unit 43 and goes to the input of the 
Discrete Cosine Transformer 21. The output of the 
Discrete Cosine Transformer 21 is quantized in a 
Quantizer 23. The output of the Quantizer 23 is 

10 split into two outputs, 121 and 131; one output 121 
goes to a downstream element 2 5 for further 
compression and processing before transmission, such 
as to a run length encoder; the other output 131 goes 
through reconstruction of the encoded macroblock of 

15 pixels for storage in Frame Memory 42. In the 

encoder shown for purposes of illustration, this 
second output 131 goes through an inverse 
quantization 29 and an inverse discrete cosine 
transform 31 to return a lossy version of the 

20 difference macroblock. This data is summed with the 
output of the Motion Compensation unit 41 and returns 
a lossy version of the original picture to the Frame 
Memory 42 . 

As shown in Fig. 2, there are three types of 
25 pictures. There are "Intra pictures" or "I" pictures 
which are encoded and transmitted whole, and do not 
require motion vectors to be defined. These "I" 
pictures serve as a source of motion vectors. There 
are "Predicted pictures" or "P" pictures which are 
3 0 formed by motion vectors from a previous picture and 
can serve as a source of motion vectors for further 
pictures. Finally, there are "Bidirectional 
pictures" or "B" pictures which are formed by motion 
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vectors from two other pictures, one past and one 
future, and can not serve as a source of motion 
vectors. Motion vectors are generated from "I" and 
"P" pictures and are used to form "P" and "B" 
5 pictures. 

One method by which motion estimation is carried 
out, shown in Fig. 3, is by a search from a 
macroblock 211 of an i + l* 1 picture throughout a region 
of the previous picture to find the best match 
macroblock 213 (211' is the same location as 211 but 
in the previous picture) . Translating the 
macroblocks in this way yields a pattern of 
macroblocks for the i+l* picture as shown in Fig. 4. 
In this way, the 1 th picture is changed a small 
amount, e.g., by motion vectors and difference data 
to generate the i+l* picture. What is encoded are 
the motion vectors and difference data and not the 
i + l 1 * 1 picture itself. Motion vectors translate 
position of an image from picture to picture, while 
difference data carries changes in chrominance, 
luminance and saturation, that is, changes in color 
and brightener. 

Returning to Fig. 3, we look for a good match by 
starting from the same location in the picture 
25 211' as in the i + l 111 picture. A search window is 
created in the i* 1 picture. We search for a best 
match within this search window. Once found, the 
best match motion vectors for the macroblock are 
coded. The coding of the best match macroblock 
3 0 includes a motion vector, that is, how many pixels in 
the y direction and how many pixels in the x 
direction is the best match displaced in the next 

EN998073 -10- 



15 



picture. Also encoded is difference data, referred 
to as the "prediction error", which is the difference 
in chrominance and luminance between the current 
macroblock and the best match reference macroblock. 

5 Even with spatial and temporal compression, the 

bitrate of the compressed digital video data stream 
is still very high. The bitrate of a compressed 
digital video data stream, as an MPEG-2 compliant 
data stream or an HDTV compliant data stream, can be 

10 adjusted by varying the amount of quantization for 

the frequency coefficients in a macroblock after the 
discrete cosine transformation (DCT) . The scaling 
factor or quantization factor by which this is 
performed uniformly over a macroblock is referred to 

15 as "stepsize" . Therefore, by using a large stepsize 
more compression will result which reduces the 
compressed stream bitrate but also reduces picture 
quality. Conversely, a small stepsize increases the 
bitrate and picture quality. 

2 0 The stepsize adjustment can be based on many 

other encoding parameters besides and/or in addition 
to the measured output FIFO buffer fullness. One 
such factor in the calculation of stepsize or 
quantization factor is the difference between the 
25 allocated bit budget and the actual number of bits 

previously used to encode the bitstream. The number 
of bits used to encode the bitstream (E) is provided 
as feedback to a processor performing the stepsize 
calculation used for quantization. The bitrate 

3 0 feedback is provided from a Variable Length Encoder 

(VLE) and Header Generation Unit (HDU) which are used 
to assemble the MPEG-2 bitstream. 
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Another factor which can be used to adjust the 
stepsize is the fullness of the external buffer, 
which in real time encoding systems is typically an 
external FIFO device . By monitoring the amount of 
5 data read (R) from the FIFOs and data used to encode 
the bitstream (E) the bitrate can be adjusted to 
prevent overflow of the external buffers 51 (Fig. 1) 
in a normal operating environment. 



To accomplish this, a read line ( F I FO_RD ) from 
10 the FIFOs is provided, for example, to a special pin 
on the video encoder module. Each time that the 
FIFOs are read an on-chip counter is incremented. A 
FIFO configuration register is also provided 
containing information about the external FIFO 
15 configuration. The width (w) of the FIFO 

configuration is set in this register to 1, 2, 4, 8 
or more bytes depending upon the application. The 
depth (d) of the external FIFO (in units of 1 k) is 
also provided in the configuration register. Using 
2 0 the read count (c) in the on-chip counter and FIFO 

width the number of bits read by the host (R) can be 
calculated: 



R = (c • w) -8 



where 

25 R = number of bits read by the host, 

c = read count in the on-chip counter, and 
w = width of the memory. 



Both the counter and the FIFO configuration register 
can be read in one embodiment using microcode. The 
3 0 microcode can then perform the R calculation. 
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In parallel, microcode can also monitor the 
number of bits encoded (E) and then subtract the 
amount of data read by the host (R) . The result of 
this calculation (E-R) will determine the fullness of 
5 the external buffer (BF) : 

BF = E - R 

Based on the depth (d) of the FIFO and system 
characteristics, an experimental limit (L) can be 
calculated and used to determine the point at which 

10 the bitrate should be adjusted to avoid buffer 

overrun. If BF>L then the stepsize will be increased 
allowing less bits for encoding. This will be 
monitored until the bitrate is adjusted such that 
BF<L. If an overrun does occur, a FIFO reset signal 

15 called FIFO_RST can be pulsed low to reset the 

external FIFOs. A FIFO reset is issued at the start 
of the next encoding picture and the FIFO writing 
process can then be restarted. The FIFO_RST signal 
is controlled with microcode and is set when 

20 microcode detects the overrun condition: 

BF > (d • 1024) * (w - 8) . 

The amount of time that bitrate is adjusted can 
be changed using microcode depending upon the 
application. For the best adjustment, this should be 

2 5 monitored every macroblock but this requires more 

calculations for every macroblock. However, because 
of code flexibility, this can be reduced to multiple 
macroblocks or slices if required. A reset on read 
function for the FIFO counter can also be provided so 

3 0 that code does not have to reset the counter after 
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every read. This reduces the amount of instructions 
needed to monitor the external buffer fullness. 

Using the existing structure, this invention can 
also be modified to provide an indication to the host 
5 that the FIFO buffer has enough data present to begin 
reading. This is useful for applications where a 
block read of data to the host is required. A FIFO 
threshold register which contains the number of bytes 
required to be stored in the FIFO prior to a read by 

10 the application is set through the host interface. 

The microcode can then read this register and compare 
it with the buffer fullness in bytes. If buffer 
fullness is greater than the number of bytes in the 
FIFO threshold register, then a signal called 

15 FIFO_BUFL (FIFO Buffer Level) will be pulsed high 

indicating that the FIFO is ready to be read by the 
host . 

One disadvantage of the above -summarized 
processing is that it is implemented in microcode, 
20 and therefore, buffer fullness is not constantly 

monitored. Without a real time view of the fullness 
of the buffer, the host processor must wait until the 
microcode goes in, polls the on-chip register and 
calculates the fullness of the FIFO. This creates a 

2 5 latency issue which produces an inherent inaccuracy 

in the FIFO fullness reading. This invention 
provides a solution by implementing FIFO monitoring 
and a dynamic FIFO buffer level indicator in hardware 
inside the digital video encoder for interfacing, for 

3 0 example, to the industry standard FIFO buffer or 

cascaded FIFO buffers. In addition, this logic 
circuitry is programmable for various FIFO 
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configurations. By implementing the invention in 
hardware, a real time buffer fullness level 
indication is possible. 



In other MPEG-2 encoding applications, memory 
5 devices instead of FIFOs are used to capture 

compressed video data. Some of these devices, such 
as field memories, do not provide EMPTY, ALMOST_FULL , 
and FULL flags, which may be standard on other memory 
types. Further, if the external memory comprises 

10 cascaded FIFOs, then any flags on the FIFOs 
themselves are unusable due to the cascaded 
architecture. The EMPTY, ALMOSTJHJLL, and FULL flags 
are useful to avoid reading the memory devices when 
they are empty, and to notify the host when the 

15 buffer is full or almost full. In accordance with 
the present invention, the flags are generated in 
real time on-chip, for example, using hardware logic 
to monitor the fullness of the external memory buffer 
and to signal to the host controller when the buffer 

20 is empty, almost full or full. In addition, this 

logic circuitry is also preferably programmable for 
various memory configurations. 

One embodiment of encoder logic in accordance 
with this invention, adapted to monitor fullness of 

25 an external FIFO buffer, is presented in Fig* 5. As 
shown, an MPEG-2 video encoder 200 provides a 
compressed data bitstream to an external FIFO buffer 
201* A host processor (not shown) reads 16 bits of 
data from the external FIFO buffer with each FIFO 

3 0 read signal (FIFO_RD) from the host. The MPEG-2 

video bitstream is provided to the FIFO 201 at the 
rate of 16 bits per write enable signal (FWE) . By 
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monitoring the write signal (FWE) to the external 
FIFO buffer, the number of encoded bytes (E) written 
to the external buffer can be counted. In addition, 
by monitoring the FIFO read line (FIFO_RD) , the 
5 number of bytes read by the host (R) can be readily 
determined, e.g., at a FIFO fullness register 220. 

Note that the example shown in Fig. 5 is for a 
2 -byte (16 bit) configuration for both the read and 
write. However, if for example the external FIFO 

10 buffer were designed for another data width, then the 
FIFO buffer configuration register 210 could be 
programmed to this different configuration. By way 
of example, FIFO buffer reads of 1, 2, 4 or 8 bytes 
may be employed. The width of the compressed data 

15 bus, which determines the number of encoded bytes 
(E) , is based on the design of the encoder 200. 

In order to determine the fullness of the FIFO 
buffer, the FIFO fullness register (FF) 220 is 
continuously updated to dynamically reflect the 
20 fullness of the FIFO buffers. This is done by 
updating the FIFO fullness register 220 per the 
following equation every cycle: 

FF = FF + E - R 

For instance, if there is a read (R) of the FIFO, 
25 then FF will be decremented based on the FIFO output 
width. A write to the FIFO (E) will cause FF to be 
incremented by the encoder output width. If both a 
write (E) and read (R) happen in the same cycle, then 
FF will be changed by the factor E - R. In the 
3 0 example shown, both E and R equal two bytes so if 
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both a read and write occur in the same cycle, then 
the fullness register remains unchanged. 

The FIFO fullness register is used to generate a 
real time FIFO buffer level indicator which is 
5 provided to the host. The FIFO buffer level 

indicator is dynamically changed by comparing at 
logic 240 the value of the FIFO fullness register 
(FF) versus a valued stored in the FIFO threshold 
register (FT) . While FT > FF, a 0 signal is sent to 

10 the host indicating that the FIFOs are not filled to 
the desired level. However, if FF > FT, then a high- 
level signal is sent to the host indicating that the 
FIFOs have reached and/or exceeded the threshold. 
The host provides the FIFO buffer threshold (FT) to 

15 FIFO threshold register 250 and may program a 

different threshold (FT) for different applications. 

As an additional feature, the encoder logic is 
preferably provided with error correction in 
accordance with the present invention to avoid error 

2 0 conditions. For example, if there is a FIFO read 

when the FF register is 0, then the read is 
preferably ignored and the FF register is not 
decremented. In addition, if the FF register is at 
the maximum value, and it receives another write then 
25 the write will be ignored and the FF register will 
not be incremented. Both of these error conditions 
are noted to avoid wrapping in the FF register. The 
size of the FF register should be made large enough 
to avoid this condition. 

3 0 In another aspect, this invention comprises 

providing logic on the encoder to generate 
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BUFFER_EMPTY , BUFFER_ALMOST_FULL , and BUFFER_FULL 
flags for non-FIFO memory devices, such as field 
memory, or for cascaded FIFO devices. A functional 
overview of this logic is depicted in Fig. 6, wherein 
5 an MPEG-2 video encoder 3 00 again feeds compressed 
data in 16-bit format to an external buffer 301, 
which in this example comprises 16 bit field memory. 
The MPEG-2 video bitstream is provided to the 
external memory buffer 3 01 at a rate of 16 bits per 
10 buffer write enable (BWE) . 

By monitoring the write signal to the buffer 
(BWE) , the number of encoded bytes (E) written to 
external memory can be counted. In addition, by 
monitoring the buffer read line (BUFFER__RD) for a 
15 buffer read signal from the host processor, the 
number of bytes read (B) by the host can be 
determined. Again, programmability is provided 
through use of a buffer configuration register 310 
for specifying whether the host processor is reading 

2 0 1, 2, 4 or 8 bytes per read signal. The example 

shown in Fig, 6 is for a 2 -byte (16 bit) 
configuration for both the read and write operations. 
However, if the external memory buffer 3 01 were 
designed for a different read data width, then the 
25 buffer configuration register 310 would be programmed 
to account for this different width. This allows the 
logic of Fig. 6 to be used in various applications. 
The width of the compressed data bus, which 
determines the number of encoded bytes (E) is based 

3 0 on the design of the encoder. The number of encoded 

bytes (E) is provided by the MPEG-2 video bitstream 
330 to a buffer fullness register (BF) 320, along 
with the number of bytes read (B) by the host. 
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In order to determine the fullness of the 
buffer, the buffer fullness register (BF) 320 is 
constantly updated to reflect the fullness of the 
memory buffer on a dynamic basis. This is done by 
5 updating the buffer fullness register per the 
following equation every cycle: 

BF = BF + E - B. 

Therefore, if there is a read (B) of the buffer, BF 
will be decremented based on the buffer output width. 

10 A write to the external buffer (E) will cause BF to 
be incremented by the encoder output width. If both 
a write (E) and read (B) happen in the same cycle, 
then the buffer fullness (BF) will be changed by the 
factor E - B. In the example shown, the number of 

15 written bytes (E) and number of read bytes (B) both 
equal 2 bytes so that if both a read and write occur 
in the same cycle, the fullness of the register is 
unchanged . 

A BUFFER_EMPTY flag is dynamically provided by 
20 comparing the value of the buffer fullness register 
320 to 0 in logic 340. If the buffer fullness is 
equal to 0, then the BUFFER_EMPTY flag to the host is 
set high, indicating that the memory buffer is empty. 
When BF > 0, the BUFFER_EMPTY flag is low. 

25 A BUF FER_ALMO S T_FULL flag is dynamically set by 

logic 350, which compares the value of the buffer 
fullness register 320 versus a value in a buffer 
threshold register (BT) 360. The buffer threshold 
register contains the threshold value in bytes 

3 0 provided by the host processor. If BF > BT, then the 
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BUFFER_ALMOST_FULL flag is set high, indicating, for 
example, that the memory buffer is almost full. The 
threshold for the almost full condition can be 
changed by reprogramming the buffer threshold 
5 register 360 through the host. If BT > BF, the 
BUFFER_ALMOST_FULL flag is low. 

A BUFFER_FULL flag is dynamically changed by 
logic 3 70 by comparing the value of the buffer 
fullness register 320 versus the buffer size register 

10 (BS) 380. If BF > BS, then the BUFFER_FULL flag is 
set high, indicating to the host that the memory 
buffer is full. Again, the size of the buffer can be 
changed for different applications by reprogramming 
the buffer size register 380 through the host. If 

15 BS > BF, then the BUFFER_FULL flag is low. 

In addition to the above aspects of the logic of 
Fig. 6, error correction is preferably provided in 
accordance with the present invention to avoid 
certain error conditions. For example, if there is a 
20 buffer read when the buffer fullness (BF) register is 
0 , then the read is preferably ignored and the BF 
register is not decremented. In addition, if the 
buffer fullness register 320 is at a maximum value, 
and it receives another write signal, then the write 

2 5 signal is preferably ignored and the BF register will 

not be incremented. Both of these error conditions 
are preferably provided to avoid wrapping in the 
buffer fullness register. Note that the size of the 
buffer fullness register should be made large enough 

3 0 to avoid this condition. 
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While the invention has been described in detail 
herein in accordance with certain preferred 
embodiments thereof, many modifications and changes 
therein may be effected by those skilled in the art. 
5 Accordingly, it is intended by the appended claims to 
cover all such modifications and changes as fall 
within the true spirit and scope of the invention. 



/ 



/ 
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Claims 



1 1 . In a method of encoding a digital video 

2 image stream in an encoder, comprising spatial 

3 compression of still images in the digital video 

4 image stream and temporal compression between the 

5 still images, wherein the spatial compression is 

6 carried out by converting a time domain image of a 

7 macroblock to a frequency domain image of the 

8 macroblock, taking the discrete cosine transform of 

9 the frequency domain image, transforming the discrete 

10 cosine transformed macroblock image by a quantization 

11 factor, and run length encoding the quantized 

12 discrete cosine transformed macroblock image, wherein 

13 the temporal compression is carried out by 

14 reconstructing the run length encoded, quantized, 

15 discrete cosine transformed image of the macroblock, 

16 searching for a best match macroblock, and 

17 constructing a motion vector therebetween, to thereby 

18 form a bitstream comprising run length encoded, 

19 quantized, discrete cosine transformed macroblocks 

20 and motion vectors, and passing the bitstream to and 

21 through an external buffer to a transmission medium, 

22 the improvement comprising feeding back to the 

23 encoder an external buffer read signal from the host 

24 and incrementing an on-chip counter each time that 

25 the external buffer is read and calculating therefrom 
2 6 the number of bits read by the host (R) , and 

2 7 determining the number of bits encoded and written 

2 8 into the external buffer (E) , and in the encoder 

2 9 subtracting from the number of bits encoded (E) the 

3 0 number of bits read by the host (R) to give the 

31 fullness of the external buffer (BF) , and providing 

32 from the encoder to the host a dynamic buffer level 
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33 
34 



indicator in real time indicative of the fullness of 
the external buffer (BF) . 



1 2. The method of claim 1, wherein said 

2 providing the host with said dynamic buffer level 

3 indicator comprises comparing the fullness of the 

4 external buffer (BF) with a buffer threshold (BT) 

5 defined by said host and providing a high-level 

6 indicator when the buffer fullness (BF) is greater 

7 than the buffer threshold (BT) , and a low-level 

8 indicator when the buffer threshold (BT) is greater 

9 than the buffer fullness (BF) . 

1 3. The method of claim 2, further comprising 

2 retaining said buffer threshold (BT) in a register 

3 within the encoder for use in said comparing of 

4 buffer fullness (BF) to the host-defined buffer 

5 threshold (BT) . 

1 4. The method of claim 1, further comprising 

2 providing an external buffer configuration register 

3 in said encoder for retaining multiple external 

4 buffer configuration values, and wherein said 

5 calculating in the encoder the number of bits read by 

6 the host (R) includes employing a predefined 

7 configuration value of the external buffer 

8 configuration register in determining the number of 

9 bits read by the host (R) upon receipt of each buffer 
10 read signal from the host. 
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1 5. The method of claim 4, wherein said 

2 multiple external buffer configuration values 

3 retained in said external buffer configuration 

4 register comprise at least some of 1, 2, 4 and 8 byte 

5 buffer configuration values, each value being 

6 representative of a number of bytes read from said 

7 external buffer with each buffer read signal from the 

8 host for a respective external buffer configuration. 

1 6. The method of claim 1, wherein said 

2 external buffer comprises a FIFO buffer and said 

3 encoder comprises an MPEG- 2 video encoder. 

1 7. The method of claim 1, wherein said 

2 external buffer comprises one of a field buffer or 

3 cascaded FIFO buffers, and wherein said dynamic 

4 buffer level indicator comprises at least one of a 

5 BUFFERJEMPTY flag, BUFFER_ALMOST_FULL flag and 

6 BUFFERJFULL flag. 

1 8. The method of claim 1, wherein said 

2 providing the host in real time with said dynamic 

3 buffer level indicator comprises providing the host 

4 in real time with multiple dynamically updated flags, 

5 said multiple dynamically updated flags comprising a 

6 BUFFER__EMPTY flag, BUFFER_ALMOST_FULL flag and 

7 BUFFER_FULL flag. 
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1 9 . In a method of encoding a digital video 

2 image stream in an encoder, comprising spatial 

3 compression of still images in the digital video 

4 image stream and temporal compression between the 

5 still images, wherein the spatial compression is 

6 carried out by converting a time domain image of a 

7 macroblock to a frequency domain image of the 

8 macroblock, taking the discrete cosine transform of 

9 the frequency domain image, transforming the discrete 

10 cosine transformed macroblock image by a quantization 

11 factor, and run length encoding the quantized 

12 discrete cosine transformed macroblock image, wherein 

13 the temporal compression is carried out by 

14 reconstructing the run length encoded, quantized, 

15 discrete cosine transformed image of the macroblock, 

16 searching for a best match macroblock, and 

17 constructing a motion vector therebetween, to thereby 

18 form a bitstream comprising run length encoded, 

19 quantized, discrete cosine transformed macroblocks 

20 and motion vectors, and passing the bitstream to and 

21 through an external buffer to a transmission medium, 

22 the improvement comprising feeding back to the 

23 encoder an external read signal from the host and 

24 incrementing an on-chip counter each time that the 

25 external buffer is read and calculating therefrom the 

26 number of bits read by the host (R) , and determining 

27 the number of bits encoded and written into the 

28 external buffer (E) , and in the encoder subtracting 

2 9 from the number of bits encoded (E) the number of 

3 0 bits read by the host (R) to give the fullness of the 

31 external buffer (BF) , and providing from the encoder 

32 to the host in real time a dynamically updated flag 

33 comprising at least one of a BUFFER_EMPTY flag, a 

34 BUFFER__ALMOST_FULL flag and a BUFFER_FULL flag. 
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1 10. The method of claim 9, wherein said 

2 providing the host in real time with said dynamically 

3 updated flag comprises providing the host in real 

4 time with at least said BUFFER_EMPTY flag, said 

5 providing of said BUFFER_EMPTY flag comprising 

6 continuously determining whether said fullness of the 

7 external buffer (BF) is equal to 0, and providing a 

8 high-level indicator when the buffer fullness (BF) is 

9 0, and a low-level indicator when the buffer fullness 
10 is greater than 0. 

1 11. The method of claim 9, wherein said 

2 providing the host in real time with said dynamically 

3 updated flag comprises providing the host with at 

4 least said BUFFER_ALMOST_FULL flag, said providing of 

5 said BUFFER__ALMOST_FULL flag comprising continuously 

6 determining whether the fullness of the external 

7 buffer (BF) is greater than or equal to a buffer 

8 threshold (BT) , and providing said host with a high- 

9 level indicator when the buffer fullness (BF) is 

10 greater than or equal to said buffer threshold (BT) , 

11 and a low- level indicator when the buffer threshold 

12 (BT) is greater than the buffer fullness (BF) . 

1 12. The method of claim 11, further comprising 

2 providing an on-chip buffer threshold register, said 

3 on-chip buffer threshold register containing a host 

4 defined buffer threshold value for use in said 

5 comparing of said buffer fullness (BF) to said buffer 

6 threshold (BT) . 
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1 13. The method of claim 9, wherein said 

2 providing the host in real time with said dynamically 

3 updated flag comprises providing the host in real 

4 time with at least said BUFFER_FULL flag, said 

5 providing of said BUFFER_FULL flag, comprising 

6 continuously comparing the fullness of the external 

7 buffer (BF) to a predefined buffer size (BS) , and 

8 providing the host with a high-level indicator when 

9 the buffer fullness (BF) is greater than or equal to 

10 said buffer size (BS) , and a low-level indicator when 

11 said buffer size (BS) is greater than said buffer 

12 fullness (BF) . 

1 14. The method of claim 13, further comprising 

2 providing an on-chip buffer size register for holding 

3 a host-defined buffer size value for use in said 

4 comparing of said buffer fullness (BF) to said buffer 

5 size (BS) . 

1 15. The method of claim 9, wherein said 

2 external buffer comprises one of an external field 

3 buffer or external cascaded FIFOs. 
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1 16. An encoder for encoding a digital video 

2 image stream in the encoder, comprising means for 

3 spatial compression of still images in the digital 

4 video image stream and means for temporal compression 

5 between the still images, wherein the means for 

6 spatial compression comprises means for converting a 

7 time domain image of a macroblock to a frequency 

8 domain image of the macroblock, means for taking the 

9 discrete cosine transform of the frequency domain 

10 image, means for transforming the discrete cosine 

11 transformed macroblock image by a quantization 

12 factor, and means for run length encoding the 

13 quantized discrete cosine transformed macroblock 

14 image, wherein the means for temporal compression 

15 comprises means for reconstructing the run length 

16 encoded, quantized, discrete cosine transformed image 

17 of the macroblock, means for searching for a best 

18 match macroblock, and means for constructing a motion 

19 vector therebetween, said means for encoding a 
2 0 digital video image stream thereby forming a 

21 bitstream comprising run length encoded, quantized, 

22 discrete cosine transform macroblocks and motion 

23 vectors and passing the bitstream to and through an 

24 external buffer to a transmission medium, the 

25 improvement comprising means for feeding back to the 
2 6 encoder an external read signal from the host, and 
27 logic in the encoder for incrementing an on-chip 

2 8 counter each time that the external buffer is read 

2 9 and calculating therefrom the number of bits read by 

3 0 the host (R) , said logic in the encoder being further 
31 adapted to monitor the number of bits encoded (E) and 
3 2 written into the external buffer and subtract from 

33 the number of bits encoded (E) the number of bits 

34 read by the host (R) to obtain the fullness of the 



EN998073 



-28- 



35 external buffer (BF) , and wherein said logic in the 

36 encoder is further adapted to provide the host with a 
3 7 dynamic buffer level indicator in real time 

3 8 indicative of the fullness of the external buffer 

39 (BF) . 

1 17. The encoder of claim 16, wherein said logic 

2 adapted to provide the host with a dynamic buffer 

3 level indicator comprises logic adapted to compare 

4 the fullness of the external buffer (BF) with a 

5 buffer threshold (BT) defined by said host and to 

6 provide a high-level indicator when the buffer 

7 fullness (BF) is greater than the buffer threshold 

8 (BT) , and a low- level indicator when the buffer 

9 threshold (BT) is greater than the buffer fullness 
10 (BF) . 

1 18. The encoder of claim 17, further comprising 

2 a buffer threshold (BT) register within the encoder 

3 coupled to said logic adapted to compare said buffer 

4 fullness (BF) to the host-defined buffer threshold 

5 (BT) . 

1 19. The encoder of claim 16, wherein said 

2 external buffer comprises at least one FIFO buffer 

3 and said encoder comprises an MPEG-2 video encoder. 

1 20. The encoder of claim 16, wherein said 

2 external buffer comprises one of a field buffer or 

3 cascaded FIFO buffers, and wherein said dynamic 

4 buffer level indicator comprises at least one of a 

5 BUFFERJEMPTY flag, BUF FER_ALM0S T_FULL flag and 

6 BUFFER_FULL flag. 
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1 21. The encoder of claim 20, wherein said 

2 dynamic buffer level indicator comprises said 

3 BUFFER_EMPTY flag, and wherein said logic is further 

4 adapted to continuously determine whether said 

5 fullness of the external buffer (BF) is equal to 0, 

6 and provide a high-level indicator when the buffer 

7 fullness (BF) is 0, and a low- level indicator when 

8 the buffer fullness is greater than 0. 

1 22. The encoder of claim 20, wherein said 

2 dynamic buffer level indicator comprises said 

3 BUFFER_ALMOST_FULL flag, and wherein said logic is 

4 further adapted to continuously determine whether the 

5 fullness of the external buffer (BF) is greater than 

6 or equal to a buffer threshold (BT) , and to provide 

7 said host with a high-level indicator when the buffer 

8 fullness (BF) is greater than or equal to said buffer 

9 threshold (BT) , and a low- level indicator when the 

10 buffer threshold (BT) is greater than the buffer 

11 fullness (BF) . 

1 23. The encoder of claim 22, further comprising 

2 an on-chip buffer threshold register, said on-chip 

3 buffer threshold register containing a host defined 

4 buffer threshold value for use by said logic in 

5 comparing said buffer fullness (BF) to said buffer 

6 threshold. 
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1 24. The encoder of claim 20, wherein said 

2 dynamic buffer level indicator comprises said 

3 BUFFER_FULL flag, and wherein said logic is adapted 

4 to continuously compare the fullness of the external 

5 buffer (BF) to a predefined buffer size (BS) , and to 

6 provide the host with a high-level indicator when the 

7 buffer fullness (BF) is greater than or equal to said 

8 buffer size (BS) , and a low- level indicator when said 

9 buffer size (BS) is greater than said buffer fullness 
10 (BF) . 

1 25. The encoder of claim 24, further comprising 

2 an on-chip buffer size register within said encoder 

3 for holding a host-defined buffer size value for use 

4 by said encoder logic in comparing said buffer 

5 fullness (BF) to said buffer size (BS) . 

1 26. The encoder of claim 20, wherein said 

2 external buffer comprises one of an external field 

3 buffer or external cascaded FIFOs. 
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1 27. An encoder for encoding a digital video 

2 image stream in the encoder, comprising means for 

3 spatial compression of still images in the digital 

4 video image stream and means for temporal compression 

5 between the still images, wherein the means for 

6 spatial compression comprises means for converting a 

7 time domain image of a macroblock to a frequency 

8 domain image of the macroblock, means for taking the 

9 discrete cosine transform of the frequency domain 

10 image, means for transforming the discrete cosine 

11 transformed macroblock image by a quantization 

12 factor, and means for run length encoding the 

13 quantized discrete cosine transformed macroblock 

14 image, wherein the means for temporal compression 

15 comprises means for reconstructing the run length 

16 encoded, quantized, discrete cosine transformed image 

17 of the macroblock, means for searching for a best 

18 match macroblock, and means for constructing a motion 

19 vector therebetween, said means for encoding a 
2 0 digital video image stream thereby forming a 

21 bitstream comprising run length encoded, quantized, 

22 discrete cosine transform macroblocks and motion 

23 vectors and passing the bitstream to and through an 

24 external buffer to a transmission medium, the 

2 5 improvement comprising means for feeding back to the 

26 encoder an external read signal from the host, and 

2 7 on-chip logic in the encoder for incrementing an on- 

28 chip counter each time the external buffer is read 

2 9 and calculating therefrom the number of bits read by 

3 0 the host (R) , said logic in the encoder being further 

31 adapted to monitor the number of bits encoded (E) and 

32 written into the external buffer and subtract from 

33 the number of bits encoded (E) the number of bits 

34 read by the host (R) to obtain the fullness of the 
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35 external buffer (BF) , and wherein said logic in the 

3 6 encoder is further adapted to provide the host in 

3 7 real time with dynamically updated flags comprising a 

3 8 BUFFER_EMPTY flag, a BUFFER__ALMOST_FULL flag and a 

3 9 BUFFER_FULL flag. 

1 28. The encoder of claim 27, wherein said 

2 external buffer comprises one of an external field 

3 buffer or external cascaded FIFOs . 

1 29. The encoder of claim 28, wherein said logic 

2 adapted to provide said BUFFER_EMPTY flag comprises 

3 logic adapted to continuously determine whether said 

4 fullness of the external buffer (BF) is equal to 0, 

5 and to provide a high-level indicator when the buffer 

6 fullness (BF) is 0, and a low- level indicator when 

7 the buffer fullness is greater than 0. 

1 30. The encoder of claim 29, wherein said logic 

2 adapted to provide said BUFFER_ALMOST_FULL flag 

3 comprises logic adapted to continuously determine 

4 whether the fullness of the external buffer (BF) is 

5 greater than or equal to a buffer threshold (BT) , and 

6 to provide said host with a high-level indicator when 

7 the buffer fullness (BF) is greater than or equal to 

8 said buffer threshold (BT) , and a low-level indicator 

9 when the buffer threshold (BT) is greater than the 
10 buffer fullness (BF) . 
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1 31. The encoder of claim 30, wherein said logic 

2 adapted to provide said BUFFER_FULL flag comprises 

3 logic adapted to continuously compare the fullness of 

4 the external buffer (BF) to a predefined buffer size 

5 (BS) , and to provide the host with a high-level 

6 indicator when the buffer fullness (BF) is greater 

7 than or equal to said buffer size (BS) , and a low- 

8 level indicator when said buffer size (BS) is greater 

9 than said buffer fullness (BF) . 



* * * * * 
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ON-CHIP DYNAMIC BUFFER LEVEL 
INDICATORS FOR DIGITAL VIDEO ENCODER 



Abstract of the Disclosure 

Method and encoder for encoding a digital video 
5 image stream. The encoding includes spatial 

compression of still images in the video stream and 
temporal compression between the still images. The 
spatial compression is carried out by converting a 
time domain image of a macroblock to a frequency 

10 domain image of the macroblock, taking the discrete 
cosine transform of the frequency domain image, 
transforming the discrete cosine transformed 
macroblock image by a quantization factor, and run 
length encoding the quantized discrete cosine 

15 transformed macroblock image. The temporal 

compression is carried out by reconstructing the run 
length encoded, quantized, discrete cosine 
transformed image of the macroblock, searching for a 
best match macroblock, and constructing a motion 

20 vector between them. This forms a bit stream of run 
length encoded, quantized, discrete cosine transform 
macroblocks and of motion vectors. This bitstream is 
passed to and through an external buffer to a 
transmission medium. The number encoded bits read by 

25 a host from the external buffer is fed back to the 
encoder for calculation in real time of a dynamic 
buffer level indicator indicative of the fullness of 
the external buffer. The encoder may generate a 
BUFFER_EMPTY flag, BUFFER_ALMOST_FULL flag and/or 

3 0 BUFFER_FULL flag for the host. 



EN998073 



-35- 



1/6 

GREENFIELD et al. 
EN998073 



4 



OH 
GO 



DO I— iTj 



a: 



S I GDUJ 
,2 0 



o, 



LU < 
Z>CQ 



6) 



O Li_ 
Q 



UJUIt/) 

£<*z 
qiujo 



ION 




INVERSE 
JANTIZATION 


JANTIZAT 
23 






0 




0 


J 








2/6 
EN998073 




Q 

>-Ld 
_J Q 
JO 
<OuJ 

Qui 
odq: 



>-a: 

Q Q 

UjLJ 

°-8 




65 



Q CO 



< 



3/6 
EN998073 



CURRENT 


FRAME 








211 






J 




MOTION 




ESTIMATION 




BLOCK 





NEIGHBORING FRAME 



r 



BEST 
MATCHING 
BLOCK 



211 



-213 



j 



SEARCHING AREA CENTERED ON 
GIVEN BLOCK IN CURRENT FRAME 



fig. 3 



4/6 
EN998073 





00 


CN 


CD 








lO 


CM 


iO 


O 






lO 


cn 





o 



cn 
z 
o 



-'-jO 

Ld < ^ 

too 

00=? 
s:>o 

Of I — ^ 

D5> 
O UJ 
Of 
Q_ 





5/6 
EN998073 



Q 

<_i 
^Z 

lZ {/) 



to 
O 
X 



o 

01 



L 



r 



oto 

l-O' 

I 



Q 
Of 



CO 
CO 

to 



CM 



tot 


O 
Li_ 


CD 


Li- 



ill 

sit- 

LlJ 



qCO 
LUt^ 
WOQO 
to U_ 

Q=<o 



J 



or 

LU 

Ll. CC 

O 0{/) 
Lu ^ 

<UJ 



LlJ 

O 
O 

z 

Ui 

o 

LU 
Q 

> 

CM 
O 
LO 
CL 



Ld 

*>Z* 

*-Olui— 

,_LL.tO< 

I— >- Qlx. 
0DCQ< Z 
Z> LUO 
O) 00 O 



L 



cm 

i 



cr 



r 



O L- 00 

Lu<|±!$Otn 

m Li_ LJ O CN CD 

o 
o 



f^QtO 

LU tO 
O LU "~" 

{^""tO 

£: a: , 

CNljQ. 

Ill 

L 



CD 



© 

CM 



II 

A 



LU 
> 



X 

o 

X 

I 

to 

LlJ 
>- 



LU 
> 



o 

_1 

I 

o 
z 



COLl. 
^ I ^ 

Z)lu >: 

Ll-I-DQ 

to., 

t±= LU 



Of 



+ 
Li_ 
Li_ 

II 



CM 



o- 

< O _i 
tOX 1- ? 

o to l — i ^ 

U.LJ ^ LO 
^f]LU=>CE 

//\ — 1 1 — Fi 

CCo 0 



o 

1 



Q I— f-N 

_l I to to 

1 oy 
Lutonh >- 

Li_ UJ|— ZE CD 

x[oO^ 

a: 



6/6 
EN998073 



CO 

m 




CO 

o 
x 



o 
< 



>- 

h- 
UJ 



U_ 

m 



< 




J 

h 



3 

CD 



O 

A 

U. 
CD 



> 
UJ 



m 
ii 

A 

m 



> 

UJ 



o ^ 



I 

o 



X 

o 

X 

I 

CO 



in 




in 




ULLNE 


ZERO 


u_ 


O 


Of 


1— 


LU 
Sjl. 
U- 


IAL 


~3 




mCf 




UJ 


CO 







cog 3 

coo^ 

UJUJ^ 

tz*-uj 

U-QiJ*- 



m 

A 

t— 

CD 

_J 
UJ 

> 

UJ 
—J 

o 

_J 

I 

o 



o 

1 



coi-!r 

CQUJ 



CO 
CD 



A 

CD 



UJ 

> 

UJ 



X 

o 

X 

I 

CO 
UJ 

>- 



CO 



00 \is 



<°f". 

c-cox'-y 

L1-L1J 



DC 



!ouj 



CD _l. - 

cou-go:^ 
gom 



QCCO 
UJ L"- UJ 

ox 

UJ 



EXPRESS MAIL LABEL NO. EL172580727US 



DOCKET NO. EN998073 
PAGE 1 OF 3 



DECLARATION AND POWER OF ATTORNEY FOR PATENT APPLICATION 

As a below named inventor, I hereby declare that: 

My residence, post office address and citizenship are as stated below 
next to my name. I believe I am the original, first and sole inventor 
(if only one name is listed below) or an original, first and joint 
inventor (if plural names are listed below) of the subject matter which 
is claimed and for which a patent is sought on the invention entitled: 

ON-CHIP DYNAMIC BUFFER LEVEL INDICATORS FOR DIGITAL VIDEO ENCODER 

the specification of which (check one) 

X is attached hereto. 



was filed on as United States 

Application Number or PCT International Application 
Number and was amended on 



I hereby state that I have reviewed and understand the contents of the 
above identified specification, including the claims, as amended by any 
amendment referred to above. I acknowledge the duty to disclose to the 
U.S. Patent and Trademark Office all information known to me to be 
material to patentability as defined in 37 CFR § 1.56. 

I hereby claim foreign priority benefits under 35 U.S.C. § 119 (a) - (d) 
or § 365(b) of any foreign application (s) for patent or inventor's 
certificate, or § 365(a) of any PCT International application which 
designated at least one country other than the United States, listed 
below and have also identified below any foreign application for patent 
or inventor's certificate, or PCT International application having a 
filing date before that of the application on which priority is 
claimed. 

Priority Claimed 

Yes No 

(Number) (Country) (Day /Month/Year Filed) 

Yes No 

(Number) (Country) (Day /Month/Year Filed) 

I hereby claim the benefit under 35 U.S.C. §119 (e) of any United States 
provisional application (s) listed below. 



(Application Number) (Filing Date) 



(Application Number) 



(Filing Date) 



DOCKET NO. EN998073 
PAGE 2 OF 3 



I hereby claim the benefit under 35 U.S. C. § 120 of any United States 
application (s) , or § 365 (c) of any PCT International application 
designating the United States, listed below and, insofar as the subject 
matter of each of the claims of this application is not disclosed in 
the prior United States or PCT International application in the manner 
provided by the first paragraph of 35 U.S. C. § 112, I acknowledge the 
duty to disclose material information as defined in 37 CFR §1.56 (a) 
which occurred between the filing date of the prior application and the 
national or PCT International filing date of this application: 



(Appl. Serial No.) (Filing Date) (Status) (patented, pending, abandoned) 



(Appl. Serial No.) (Filing Date) (Status) (patented, pending, abandoned) 

POWER OF ATTORNEY: As a named inventor, I hereby appoint the following 
attorney (s) and/or agent (s) to prosecute this application and transact 
all business in the Patent and Trademark Office connected therewith: 



Christopher A. Hughes, Esq. 


Reg. 


No. 


26, 914 


Edward A. Pennington, Esq. 


Reg. 


No. 


32,588 


John E. Hoel, Esq. 


Reg. 


No. 


26,279 


Joseph C. Redmond, Jr., Esq. 


Reg. 


No. 


18,753 


David L. Adour, Esq. 


Reg. 


No. 


29, 604 


Lawrence R. Fraley, Esq. 


Reg. 


No. 


26, 885 


Arthur J. Samodovitz, Esq. 


Reg. 


No. 


31,297 


Bernard Tiegerman, Esq 


Reg. 


No. 


29, 707 


John R. Pivnichny, Ph.D. 


Reg. 


No. 


43,001 


Jeff Rothenberg, Esq. 


Reg. 


No. 


26,429 


Kevin P. Radigan, Esq. 


Reg. 


No. 


31, 789 


Blanche E. Schiller, Esq. 


Reg. 


No. 


35,670 



Send Correspondence to: 

Kevin P. Radigan, Esq. 
HESLIN 8c ROTHENBERG, P.C. 
5 Columbia Circle 
Albany, New York 12203-5160 
Telephone: (518) 452-560 0 
Facsimile: (518) 452-5579 

I hereby declare that all statements made herein of my own knowledge 
are true and that all statements made on information and belief are 
believed to be true; and further that these statements were made with 
the knowledge that willful false statements and the like so made are 
punishable by fine or imprisonment, or both, under Section 1001 of 
Title 18 of the United States Code and that such willful false 
statements may jeopardize the validity of the application or any patent 
issued thereon. 
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ADDED PAGE(S) TO COMBINED DECLARATION AND POWER OF ATTORNEY 
FOR SIGNATURE BY FIRST AND SUBSEQUENT INVENTORS 

Full Name of first joint inventor: James D. Greenfield 

Signature : 

Date: 

Residence: 34 Wo^inger Way, Binghamton, NY 13 904 
Citizenship : U.S.A. 

Post Office Address: 34 Wolfinger Way, Binghamton, NY 13904 
Full Name of second joint inventor: John M. Kaczmarczyk 

Signature: sf '/f^S J^^f^ Date: 

Residence: ^908 Sarah Lane, Endicott, NY 13 760 
Citizenship: U.S.A. 

Post Office Address: 908 Sarah Lane, Endicott, NY 13760 



Full Name of third joint inventor: Agnes Y. Ngai 

Signature: i^%o^ 14 /LQfrx Date: 



Residence: 725 Partridge Place, Endwell, NY 13760 
Citizenship: U.S.A. 

Post Office Address: 725 Partridge Place, Endwell, NY 13760 

Full Name of fourth joint inventor: 

Signature : _ Date : 

Residence : 

Citizenship : 

Post Office Address: 



